Multiple POS Dependency-Aware Mixture of Experts for Frame Identification
نویسندگان
چکیده
Frame identification, which is finding the exact evoked frame for a target word in given sentence, fundamental and crucial prerequisite semantic parsing. It generally seen as classification task words, whose contextual representations are usually obtained using neural network like BERT an encoder, enriched with joint learning model or knowledge of FrameNet. However, distinction at fine-grained level, such delicate differences information syntax PropBank roles caused by different parts-of-speech (POS) neglected. We propose Multiple POS Dependency-aware Mixture Experts(MPDaMoE) that integrates five types information, consisting syntactic words nominal, adjectival, adverbial, prepositional, role only verbal. To better learn Experts employed, every expert Graph Convolutional Network, to incorporate dependency words. Our outperforms state-of-the-art models experiments on two benchmark datasets, shows its effectiveness.
منابع مشابه
Similarity Based Genre Identification for POS Tagging & Dependency Parsing Experts
POS tagging and dependency parsing achieve good results for homogeneous datasets. However, these tasks are much more difficult on heterogeneous datasets. In (Mukherjee et al., 2016, 2017), we address this issue by creating genre experts for both POS tagging and parsing. We use topic modeling to automatically separate training and test data into genres and to create annotation experts per genre ...
متن کاملCreating POS Tagging and Dependency Parsing Experts via Topic Modeling
Part of speech (POS) taggers and dependency parsers tend to work well on homogeneous datasets but their performance suffers on datasets containing data from different genres. In our current work, we investigate how to create POS tagging and dependency parsing experts for heterogeneous data by employing topic modeling. We create topic models (using Latent Dirichlet Allocation) to determine genre...
متن کاملLSTM-Based Mixture-of-Experts for Knowledge-Aware Dialogues
We introduce an LSTM-based method for dynamically integrating several wordprediction experts to obtain a conditional language model which can be good simultaneously at several subtasks. We illustrate this general approach with an application to dialogue where we integrate a neural chat model, good at conversational aspects, with a neural question-answering model, good at retrieving precise info...
متن کاملA Bayesian Mixture Model for PoS Induction Using Multiple Features
In this paper we present a fully unsupervised syntactic class induction system formulated as a Bayesian multinomial mixture model, where each word type is constrained to belong to a single class. By using a mixture model rather than a sequence model (e.g., HMM), we are able to easily add multiple kinds of features, including those at both the type level (morphology features) and token level (co...
متن کاملMixture of Experts for Persian handwritten word recognition
This paper presents the results of Persian handwritten word recognition based on Mixture of Experts technique. In the basic form of ME the problem space is automatically divided into several subspaces for the experts, and the outputs of experts are combined by a gating network. In our proposed model, we used Mixture of Experts Multi Layered Perceptrons with Momentum term, in the classification ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Access
سال: 2023
ISSN: ['2169-3536']
DOI: https://doi.org/10.1109/access.2023.3253128